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Select frames with a fixed interval from an input video sequence 
and create the feature frame matrix A 
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Perform SVD on A to obtain matrix V T with columns representing 
frames in the refined feature space 
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In the refined feature space, find the most static cluster, compute the 
content value of this cluster and use this value as a threshold to 
cluster the rest of the frames 
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For each obtained cluster find the longest video shot in the cluster. 
Discard clusters with the longest video shot shorter than 1 second 
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According to user request output a set of key frames representing 
frame cluster, or a summarized video with user-specified length 



FIG. 1 



In the refined feature space, sort all the vectors in ascending order using 
distance defined by Eq. 4. Initialize all the vectors as unclustered vectors, 
and set cluster counter C = 1 
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Among the unclustered vectors, select the one that is closest to the origin as 
the seed to form cluster S c . Set the average internal distance of the cluster |a/202 
R(S C ) = 0, and frame command P c = 1 



For each unclustered vector calculate its minimum distance to cluster S c : 
dmin (¥ i ,S c ) = minD(v)/ i , y k ) 
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Add frame to cluster S! 
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Add frame to cluster S c 
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Terminate the operation 



Increment cluster counter C by 1 
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Sort shots in descending 
order by length, select the 
top N shots, and assign 
equal time length T min to 
each selected shot 



For each cluster S 4 find the 
longest video shot Q { 
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Yes 



Select all the shots Q i where 
i = 1,2,... C, and assign 
equal time length T len /C to 
each of the shots 
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Sort the selected shot by the time 
code, based on this sorted order, get 
from each selected shot a portion of 
the assigned time length, and insert it 
into the summarized video 
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FIG. 4 



Sample the input video 
sequence with a fixed rate, 
and create a feature-frame 
matrix A 
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Perform SVD on A 
to obtain matrices E K 402 
andV 1 " 



Compute similarity SIM (i, 

i+1) for all frames in the 
sample set and segment the 
video sequence into video 
shots along the time axis 
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Compute the average feature vector \\j s 
for each shot 0, 
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511 



Mark location 
between frames I 
and 1+1 as a shot 
boundary 
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Set 
S=l and 1=1 



A/ 501 



Create shot 9 S with 
frame I as its first 
element 
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Insert frame 1+1 into 
shot 0 S , and set 



1=1+1 
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No 
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Find the frame x>I+l 
that satisfies 
D(M> x> Vx + i)^T l0W 




Yes 



508 



Mark the frames 
between 1+1 and x as a 

gradual transition 
between the two shots 
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Group frames from 1+1 to 
X into shot 9 S , set I=x+1 
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Terminate the 
operation 
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